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We have studied quantum data compression for finite quantum systems where the site density 
matrices are not independent, i.e., the density matrix cannot be given as direct product of site 
density matrices and the von Neumann entropy is not equal to the sum of site entropies. Using the 
density-matrix renormahzation group (DMRG) method for the 1-d Hubbard model, we have shown 
that a simple relationship exists between the entropy of the left or right block and dimension of the 
Hilbert space of that block as well as of the superblock for any fixed accuracy. The information loss 
during the RG procedure has been investigated and a more rigorous control of the relative error has 
been proposed based on Kholevo's theory. Our results are also supported by the quantum chemistry 
version of DMRG applied to various molecules with system lengths up to 60 lattice sites. A sum rule 
which relates site entropies and the total information generated by the renormalization procedure 
has also been given which serves as an alternative test of convergence of the DMRG method. 



I. INTRODUCTION 

In the past few years non-local generalizations P, Q 
of the density-matrix renormahzation group (DMRG) 
method have gained much attention since the 

method allows to study interacting spin and electron sys- 
tems in momentum space 0, 0, or molecules within the 
context of quantum chemistry 01 IE Hi IS ^i 0| ■ 

Recently the concepts of information theory have reap- 
peared in the study of solid state physics and statistical 
physics problems |a, 0, 13- On the one hand, 

it has been pointed out 12, 13] that the von Neumann 
entropy of a finite system of length N, 

5(pW) = -Tr(pWlnpW), (1) 

where p^^^ is the density matrix, diverges logarithmi- 
cally with the system size if the system is critical and the 
spectrum is gapless, while it saturates as N increases 
for non-critical, gapped models. On the other hand, 
in an independent work j^, the von Neumann entropy 
has been used to improve the performance of the mo- 
mentum space and quantum chemistry versions of the 
DMRG method. It has been shown that an optimal or- 
dering of states can be obtained from the distribution 
of site von Neumann entropies of "lattice sites" . Quite 
recently, the study of entanglement has also led to a 
new procedure using periodic boundary condition [T^ 
that increases dramatically the performance of real space 
DMRG (RS-DMRG) method and to the development of 
time-dependent DMRG algorithm [TtLITsII . 

An important problem in quantum information theory 
is quantum data compression 0, |23, 0, H^l, i.e., how 
the dimension of the typical subspace should be chosen 
to achieve a prescribed fidelity. The DMRG method is 
based on a similar reduction of the Hilbert space. In 
the standard DMRG procedure the dimension, the num- 
ber of states to be kept, is fixed before the calculation. 
In the dynamical block state selection (DBSS) approach 
llOjl the truncation error is kept fixed and the dimension 



is allowed to vary. It has been shown jal that the pre- 
scribed accuracy can be achieved with the least number 
of block states, if the entropy-optimized ordering is used. 
In this paper, we study this problem from the point of 
view of quantum data compression and show that a sim- 
ple relationship exists between the von Neumann entropy 
of subsystem blocks and the size of Hilbert space of the 
blocks or alternatively the size of Hilbert space that one 
has to diagonalize in DMRG. We argue that the accessi- 
ble information 2M of mixed-state ensembles can be 
interpreted in the context of DMRG as the information 
loss due to the truncation procedure. Relying on this 
we propose a new method to improve the convergence of 
DMRG. 

The main purpose of this paper is to study the prop- 
erties of DMRG from the point of view of quantum in- 
formation theory and to use the obtained results to op- 
timize the method. The setup of the paper is as follows. 
In Sec. II we describe the theoretical background of data 
compression, accessible information for mixed-state en- 
sembles, and their relation to the DMRG method. In 
Sec. HI these concepts and quantities are studied by ap- 
plying the RS-DMRG to the half-filled 1-d Hubbard chain 
using open and periodic boundary conditions and the 
non-local generalization of DMRG to various molecules. 
In Sec. IV the obtained results are interpreted as quan- 
tum information generation in the DMRG method. Our 
conclusions are presented in Sec. V. 

II. QUANTUM DATA COMPRESSION 

In his landmark work |25j| . Shannon has shown how 
much a message constructed from N independent letters 
(xa), where each letter occurs with a priori probability 
Pa, can be compressed. In classical information theory 
messages are classified into so-called typical and atypical 
sequences. If for any e > the sum of the probabilities 
of all typical sequences lies between 1 — e and 1 , then for 
any S > and for large enough values of N the num- 
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ber of typical sequences n(e, i5) lies between the bounds 
2N{s+s) > ^^^^ (5) > (1 - e)2^(^-'5), where S is the Shan- 
non entropy, S — -~J2aPa^'^S2Pa- Therefore, a block 
code of length NS bits encodes all typical sequences ir- 
respective of how the atypical sequences are encoded and 
the probability of error will still be less than e. 

In quantum information theory the letters are density 
matrices and one has to distinguish two cases, namely 
when the density matrices correspond to ensembles of q 
pure states, \<f>a), or when they are formed from density 
matrices Pa , with probability Pa . 



A. Pure-state ensemble 

Considering the first case, that is a pure-state ensemble 
the density matrix of a message consisting of N letters is 
p(^) = pig) pig) ...ig) p, where p = YliaPa\4>a){4>a\, and the 
von Neumann entropy of the message is simply related 
to the entropy of the ensemble, S{p'-^^) = NS{p). The 
optimal code that compresses the Hilbert space of the 
entire message, A'^^^ = A(2)A(g)---Atoa smaller Hilbert 
space without compromising the fidelity of the message 
for N ^ oo has been obtained by B. Schumacher [l9l |. 
Analogously to classical information theory A'^' is di- 
vided into so-called typical (A^^^) and atypical (A^^p) 
subspaces by applying a projection Iltyp and Ilatyp- If for 
any e > almost all weight of the ensemble lies within 
A^^^ and TrHtypP^^^Htyp > 1 - e while for the atypi- 
cal subspace TrllatypP^^^ Ilatyp < e, then for any 6 > 
and sufficiently large enough N the eigenvalues Wtyp of 
p^^' belonging to typical eigenstates fall within a narrow 
range: 



is bounded by 



,-NlSip)+S] 



< UJn < e 



-NlS{p)-S] 



(2) 



Therefore, the number of dimensions of the typical sub- 
space lies between the bounds 



(1 



^NlS{p)-S] 



< dimAiyp^ < e 



(N) , N[S{p)+5] 



(3) 



This means that the von Neumann entropy is the number 
of qubits of quantum information carried per letter of 
the message and unless p = ^1, a compression is always 
possible. We have to mention that Eqs. lOl-® have been 
reformulated in order to be consistent with Eq. (|T|). 



B. Mixed-states ensemble 

The result is less simple if the letters are chosen from 
density matrices of mixed states. In this case only an 
upper [23 or lower bound 0| can be derived for the 
accessible information. Therefore, if the source of infor- 
mation is constructed from messages represented by pa 
states and a priori probability pa , then the mutual infor- 
mation between the sender's and receiver's measurement 



I < S{p) - ^PaS{pa) 



(4) 



where p = ^ a Pa Pa and S is the von Neumann entropy 
given by Eq. If all signal states pa are pure states, 
the upper bound on the accessible information reduces 
to / < S{p). 

The lower bound on accessible information also de- 
pends not only on the entire density matrix but also on 
the particular way p is realized as an ensemble of mixed 
states. As it has been given by Jozsa et al. [26|. 
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where the subentropy Q is defined as 



(5) 
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(6) 



If two or more of the eigenvalues are equal, Q remains 
finite if one takes the limit uja ^ w/3. 



C. Relationship to DMRG 

For lattice models, studied in solid state physics prob- 
lems, on the other hand, the message coded into the wave 
function of the system has different features. The site 
density matrices are in general not independent, thus 



plJV) ^ p (g, p ... (g, p and S{p^^^) ^ NS{p). In this 
paper, this situation is studied using DMRG. 

From the point of view of information theory DMRG is 
a numerical tool to select the typical subspace on which 
the target state (5'tg) of a Hamiltonian of a finite system 
of length N can be represented. The Hilbert space of the 
system (called superblock Hilbert space) is defined on a 
bi-partite system, Atyp = A, 



a|^' where A^yp and 



A^^^ are the typical Hilbert spaces of the left and right 
blocks, Bl and Br, which themselves are built from sub- 
blocks, Bi and Br, with one extra site. The indices I and 
r denote at the same time the number of sites in the sub- 
blocks. The schematic plot of the DMRG configuration 
is shown in Fig. ^ 

Although the target state is usually a pure state, the 
left and right blocks are in a mixed state described 
by the density matrices pL = Tr^p, and pn = Tr^p, 
respectively. Analogously one can define the density 
matrices of the Bi and B^ subblocks, pi — Trs^Tr/jp, 
Pr = Tr^Trs^p, as well as that of the intermediate sites, 
given as ps, = Tr;Tri?p, ps^ = TriTr^p. It follows from 
singular value decomposition theorem that for a pure tar- 
get state and any choice of the length of the left sub- 
block, the entropy of the left block of length I + 1, 
Sl{1 + ^) is identical to that of the right block, Sii{r~\-1), 
where I + r + 2 = N . S = Sl = Sr is also related 
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FIG. 1: Schematic plot of the system and environment block 
of DMRG. Bl and Br denote the left and right block of length 
I and r, and of dimension Mi and M,-, respectively, • stands 
for the intermediate sites (s; and Sr) with qi and qr degrees 
of freedom. The blocks Bl ~ Bi», Br — mBr have dimension 
Ml and Mr, respectively. 



of the left and right blocks, M, is fixed in advance of 
the calculation. The superblock Hilbert space, Asb, 
on which the target state is determined is not simply 
Ajyp (g) Aj^p , since only states with prescribed quantum 
numbers have to be considered. Usually M is increased 
systematically during the finite lattice method, thus the 
accuracy depends on M in an uncontrolled way. In con- 
trast to this in the DBSS approach J^] the truncation 
error is kept fixed and the number of retained states is 
varied dynamically, which allows to control the accuracy 
more precisely. A threshold value on the minimum num- 
ber of block states Mmin has also been introduced in 
order to avoid higher lying local minima. 

III. NUMERICAL RESULTS 



to the mutual information of the blocks, / — —25* since 
SL{l + l) + SR{r + l) + I = S{N), where S{N) is the en- 
tropy of the full system, which vanishes if the system is in 
a pure state. / quantifies the correlation between the two 
subsystems and vanishes if and only if the two subsystems 
are completely uncorrelated, i.e., when p = pl ® PR- S 
also measures the entanglement and the amount of 
quantum information exchange between the blocks p^ . 

The wave function of the finite lattice of length N is 
built up using the infinite lattice method followed by 
a systematic application of the sweeping procedure of 
the finite lattice method. The typical subspaces A^yp 
and Aj^p are obtained by selecting that M renormal- 
ized states out of the M x I block states (|(/)q^''), |(/)q^'')), 
which have the largest eigenvalues, m^'a^ and cji^-* of the 
density matrices pL and pR, respectively. The H^p and 
n^p projection operators are formed from the M chosen 
eigenstates of and pR. The accuracy of the trunca- 
tion procedure is given by the so-called truncation error, 
TRE = 1 — X]q=i ^a, where cJq, = uj^a^ or t^i^'', depend- 
ing on the direction of the sweep. Therefore, due to the 
truncation of basis states e is always greater than zero. 

Another main difference between conventional infor- 
mation theory and DMRG is that while in the former 
case the letter states have an a priori assigned probabil- 
ity density |33| , in the latter case the probability of 
a configuration depends on the target state. Therefore, 
the subset of states which define the code words is de- 
termined by the physical properties of the target state. 
When DMRG is applied to find the typical subspace of 
a target state, i.e., the typical code words, this subspace 
is reduced further. In addition, during the RG proce- 
dure the original basis states are also transformed into 
new renormalized states, thus code words change at each 
iteration step. In this respect, in DMRG the informa- 
tion of one block is coded into the basis function of the 
renormalized blocks rather than into a quantum channel 
of qubits. 

In the standard DMRG procedure the number of states 



The most general fermionic Hamiltonian can be given 

as 

^ = Xl^y^'-'^^J'^ + H ^^3klctc]<y'^ka'Cla, (7) 
ij(T ijklaa' 

where Tij denotes the matrix elements of the one-particle 
Hamiltonian and Vijki stands for the matrix elements 
of the electron interaction operator. Depending on the 
structure of Tij and Vijki this Hamiltonian can describe 
fermionic models in real space with open or periodic 
boundary condition, a molecule or a usual fermionic 
model in momentum space. 

A special case of Eq. Q is the 1-d Hubbard model, 

^ = E + J + (7 E 4^^^Al'^^l ■ (8) 

In this case the states are |0}, | |), | t), | |t). For 
homogeneous lattice models with periodic boundary con- 
dition each lattice site carries the same information (Si). 
For C/ = 0, 5j = 41n4 = 1.38629 while for [/ ^ oo the 
model is equivalent to the spin— 1/2 Heisenberg model 
and only the | J,) and | t) states have finite weight, thus 
Si = 2 In 2 = 0.69314. In the numerical work we have 
used the real space version of DMRG with open (OBC) 
and periodic (PEG) boundary conditions. 

A. The standard DMRG procedure 

First we have investigated the block entropy in 
the standard RS-DMRG method when calculating the 
ground state energy of the half-filled 1-d Hubbard model 
with i = 1 for a chain with A^ = 80 sites, for U = 
1, 10, 100 using a fixed number of block states, namely 
M = 256, 512, 1024. In Fig. H we have plotted the block 
entropy and the logarithm of the dimension of A and the 
Hilbert space of the superblock, ln(dim A), ln(dim Ags), 
respectively, as a function of iteration steps for f/ = 1 
and M = 512. It is clear from the figure that for the in- 
finite lattice method (for iteration steps less than 39) the 
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FIG. 2: Block entropy, S, and In(dimA), ln(dimAs_B) as 
a function of iteration steps for the half-filled 1-d Ifubbard 
model with A'' = 80 for U — 1 with fixed number of block 
states (M = 512) using PBC. For iteration step less than 39 
the infinite lattice method has been used. 



block entropy, S, increases with the block length. Ac- 
cording to Vidal et al. 0, a logarithmic divergence 
is expected if no truncation had been applied during the 
RG procedure. Deviations occur for two reasons. First 
the truncation procedure has been applied from the 5th 
iteration step. More importantly, in DMRG the chains 
are built up systematically, and for chains of length N 
the finite lattice method has to be used after N/2 — 1 ini- 
tialization steps. At this point the entropy of the blocks 
starts to decrease. In the successive sweeps the entropy 
reaches its maximum when the sizes of the two blocks 
become equal. It is worth mentioning that S became 
almost totally symmetric after the second half sweep al- 
ready. Since S is related to the mutual information of the 
blocks this result is in agreement with the long known 
fact that the best accuracy of RS-DMRG is always ob- 
tained for the symmetric block configurations. For larger 
U values the entanglement between the blocks is reduced 
as indicated by the decreasing value of S and Si, while 
ln(dim A) remained almost the same, and the relative er- 
ror of the calculations improved significantly. This is the 
first sign that the entropy, the dimension of the Hilbert 
space and the accuracy is related to each other in DMRG. 



B. BBSS approach 

This standard procedure, however, does not allow an 
a priori control of the accurac y, w hile this control is pos- 
sible in the DBSS approach Moreover, the latter 
approach allows to study the relationship between the 
von Neumann entropy of the block and the dimension of 
the Hilbert space of the superblock qualitatively. There- 
fore, we have repeated the DMRG calculations on the 
same model using the DBSS approach with Mmin — 16 
for various values of the truncation error, namely for 
TRE^ax = 10~^ 10^3^ . . . xo-8. In Fig. 01 we have plot- 
ted In(dimA), ln(dimA5B) and the block entropy ob- 
tained after the 6th sweep for [/ = 1, TV = 80 as a func- 



FIG. 3: Same as Fig. 2 but using DBSS approach for 
TREmax = 10"'' and M™™ = 16. 
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FIG. 4: Parameter /3 as a function of rescaled iteration step 
using DBSS approach for TREmax = 10"", M^in = 16, C/ = 
1, iV = 40,60, 80. 



tion of iteration step shifted modulo 80. It is clearly seen 
in the figure that due to the truncation of basis states 
the logarithmic corrections are cut, S and In(dimA) is 
almost constant for a wide range of block lengths. A 
simple relationship seems to exist between the two quan- 
tities, which is analogous to Eq. ||2Jl. We define the shift 
between In(dimA) and S as 



P = In(dimA) -S. 



(9) 



Fig. H shows the value of /3 for [/ = 1, TREmax = lO""* 
for three different chain lengths, N — 40, 60, 80. /3 is plot- 
ted as a function of the shifted iteration step rescaled by 
the length of the chain. We have found that after the 
sixth sweep except for very short block lengths (3 is prac- 
tically independent of N for a given accuracy. A similar 
result is expected for non-critical systems since accord- 
ing to Vidal et al. 01 in this case the block entropy 
saturates with increasing block length. It is worth men- 
tioning that /]' defined analogously to Eq. lO but with 
ln(dim Asb), 



/3' = In(dimAsB) -S, 



(10) 



is also independent of N for large enough N. 

Both f3 and /3' are, however, functions of TREmax- 
This dependence has been tested ior U = 1 for 
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TREraax = 10"^ - 10"**, when max(ln(dim Ass)) 
changed from 6 x 10'^ to 2.1 x 10^. In this range 
of the truncation error (3 increases proportionally to 
— hiTREmax- Similar results have been obtained with 
open boundary condition but with significantly smaller 
block entropies and much less block states. For larger U 
values and for small values of TREmax the target state 
has often been lost and the convergence depended very 
much on the minimum number of block states Mmin- 
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C. A new truncation procedure 



FIG. 5: Schematic plot of the upper and lower bonds on ac- 
cessible information for a binary channel. 



The simple relationships given by Eqs. © and 
seem to indicate that a better DMRG procedure that 
avoids the above mentioned problems should rely on the 
control of the von Neumann entropy of the blocks. In or- 
der to control the weight of retained information during 
the RG procedure in a more rigorous way, the reduced 
density matrix of the left or right subsystem is written 
as the sum of the density matrices of mutually orthog- 
onal mixed states belonging to the typical and atypical 
subspaces, 



p'-^^ = PtypPtyp 



(1 



" ?'typ)pityp : 



(11) 



where p[yp is formed from the M largest eigenvalues 

of p^^^ and pi^yp from the remaining eigenvalues with 

Trp^yp = Trp^^yp = 1. Similar decomposition holds for 
the right block, and therefore in what follows the super- 
script L and R are dropped. In usual information theory, 
if the message contained ptyp or Patyp with the appropri- 
ate probabilities, the accessible information for such a 
binary channel would be less than the Kholevo bound 

M 

I < S{p) ~PtypS{ptyp) - (1 -Ptyp)5'(patyp) , (12) 

and larger than the Jozsa-Robb-Wootters lower bound 

M 

I > Q{P) - PtypQ(Ptyp) - (1 - Ptyp)Q(Patyp) • (13) 

The schematic plot of the two bounds as a function of 
Ptyp is shown in Fig. \^ It is worth to mention that other 
ensemble dependent bounds have been derived by Fuchs 
and Caves p^ . 

In DMRG, however, the atypical subspace is neglected, 
which leads to a loss of information. For ptyp close to 
unity this loss is argued to be equal to the accessible 
information which is negligible if the probability of the 
atypical subspace is negligible. This can be used to opti- 
mize the DMRG procedure. A modified DBSS procedure 
is proposed, where instead of fixing the truncation error, 
the Kholevo bound is required to be less than an e fixed 
in advance, and the number of states M is chosen accord- 
ingly in every step. 

We have run independent calculations for the 1-d Hub- 
bard model for different threshold values on the upper 
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FIG. 6: The relative error as a function of the truncation 
error and the threshold value of Kholevo's bound on accessible 
information obtained with the DBSS method and by Eq. II12|I . 
respectively. 



bound of accessible information, denoted by x, rang- 
ing from 10"^ to 10""^ using three sweeps. In Fig. 
we have plotted the relative error as a function of 
TRE and x on a logarithmic scale for U = 1,10,100 
with Mmin — 4, where the relative error is given as 
(-Bdmrg --Bcxact)/£'cxact- Wc havc fouud that this selec- 
tion rule is very stable even for very small values of the 
retained eigenvalues of ptyp- Assuming that the linear 
relationship apparent on the right panel holds for other 
models as well, a new extrapolation procedure can be ob- 
tained. Instead of usin g th e truncation error as proposed 
in Refs. 0, 1^ IS USEI i the energy of the target state 
is extrapolated as a function of x- 



D. Application to quantum chemistry DMRG 

We have tested the new truncation procedure pre- 
sented above by performing DMRG calculations on var- 
ious molecules up to 59 lattice sites. We have used the 
dynamically extended active space procedure (DEAS) 
and the DBBS approach by controlling the change of von 
Neumann entropy during the truncation procedure at 
each renormalization step. In all calculations Mmin — 4 
was used and during the first half sweep the right block 
was represented by 256 — 512 states. The maximum num- 
ber of block states that our program could treat is in 
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FIG. 7: The first panel shows the relative error as a function 
of the threshold value of Kholevo's bound on accessible in- 
formation obtained by Eq. 11211 . The second panel shows the 
error in the sum rule given by Eq. 11911 . 



the range of 2000-3500, strongly depending on the sys- 
tem size. Our results on various molecules are shown in 
Fig. [3 We have found again that on a logarithmic scale 
the relative error is a linear function of the accessible 
information even for large threshold values. 

For very small system sizes, like CH2 (6/13) the num- 
ber of block states has been overestimated by using the 
upper bound on the accessible information. Therefore, 
we have also tried to control the lower bound on acces- 
sible information. For large threshold values, the lower 
bond on accessible information has also provided similar 
results but with less number of block states. For smaller 
threshold values, however, we have found it to be very 
unstable for increasing M with larger values of ptyp- 

When molecules are studied in quantum chemistry ap- 
plication, "lattice sites" carry different quantum infor- 
mation as described by a non-constant value of the site 
entropy function. This means that the entropy profile of 
the bi-partite partitioning of the finite system depends 
very much on the ordering of the lattice sites. Since the 
molecules are non-critical models, one can obtain the en- 
tropy profile of the exact solution of the finite system 
with an exponentially small error using a limited num- 
ber of block states. Since the block entropy is related 
to the size of the superblock Hilbert space, in order to 
increase the efficiency of the DMRG method one has to 
reduce the block entropy profile of the exact solution by 
optimizing ordering. For larger systems we have found 
that the optimization procedure outlined in Ref. 6] based 
on the site entropy profile alone, does not lead to opti- 
mal ordering and it often blocked the convergence of the 
DMRG method. This problem related to the competi- 
tion between entanglement localization and interaction 
localization will be investigated in a subsequent paper. 



IV. RELATIONSHIP TO QUANTUM 
INFORMATION GENERATION 

In the DMRG procedure, during the renormalization 
step the block is formed of the subblock Bi and the 
I + 1*"^ site. Denoting by Sl{1) the entropy of the left 
subblock of length I and by 5";+! the entropy of the I + 1^^ 
site, the change of the block entropy by forming a larger 
block, Bl{1 + 1), is given as 



SLil) + Si+i+lL{l) = SL{l + l), 



(14) 



where the so-called mutual information /l(0 quantifies 
the correlation between the subsystem and the site. A 
similar relation holds for the right block, given as 



SR{r)+Si+2+lB.ir)^SRir + l). 



(15) 



The unitary operation applied on the basis states of the 
Bi • composite system is a type of LOCC (local quan- 
tum operations or classical communications) operation, 
i.e., it cannot increase the entanglement between B^ and 
Bfj blocks which has also been related to entanglement 
distillation protocols js^ . Therefore, the entropy of the 
Bi • composite system remains unchanged or decreased 
by forming the larger block B^. The quantum informa- 
tion generated by the renormalization procedure of the 
forward sweep can be measured using Eq. (|14|l as 



lLil) = SLil + l)-SL{l)-Si+i 



(16) 



where I runs from 1 to — 1. Analogously the infor- 
mation generated by the backward sweep can be derived 
using Eq. (fTK|l . 

If an effective system of length iV + 2 is formed by 
adding two non-interacting sites to the right end of the 
chain, all blocks containing 1 to TV lattice sites of the 
original system can be formed by the forward sweep. The 
total information gain of a full half sweep can be calcu- 
lated as T,i=iIl{1)- The same holds for the backward 
sweep as well when the two non-interacting sites are at- 
tached to the left end of the chain. It is easy to show that 
if all g' and basis states of the blocks are kept at each 
iteration step, i.e., no truncation is applied, a sum rule 
holds, which relates the total information gain within a 
full half sweep and the sum of site entropies given as 



N 



(17) 



1=1 



where we have used S'l(I) = Si and Sl{N) = 0. This 
equality, however, does not hold in practical DMRG cal- 
culations. First the blocks contain only a limited subset 
of the block states thus for a given site Si changes for each 
half sweep as the method converges to the attractor. In 
addition, during the renormalization process Sl{1 + ^) is 
reduced to S'J^''""'^(Z -I- 1) due to the truncation of basis 
states, thus /l(/) is also a function of subsequent sweeps. 
However, once the DMRG method has converged, i.e.. 
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subsequent DMRG sweeps do not change Sl{1) and Si, 
the foUowing equahty should hold to a good accuracy 

N-l N N 

^ /^(O ^ - ^ 5, + 5] (sui) - ^^"^(O) ■ (18) 

1 = 1 1 = 1 1=2 

An analogous relationship holds for the backward sweep 
as well. 

As one sees in Fig.|21the decrease of the loss of informa- 
tion goes together with the decrease of the contribution 
of the atypical states. Although the actual shape of the 
upper and lower bounds depends on U , we have found 
that when only the first few eigenvalues of p are retained, 
Ptyp is already very close to unity. Therefore, the loss of 
information could be equally controlled by requiring that 
X = S{p) — S{ptyp) should become less than e in which 
case Eq. lfTH|) leads to 

N-l N 

^/L(0 + 5]5z<(iV-lK (19) 

1=1 1=1 

Eq. (|19|l can be used as an alternative procedure to check 
the convergence of the DMRG method. 

Numerically we have found a very similar result to the 
one shown in the previous section, that the relative error 
and J2i ^(0 + J2i linear functions of x on a loga- 

rithmic scale. The second panel of Fig.[3shows the error 
in the sum rule given by Eq. H19|l for the calculation pre- 
sented in Sec. Ill D. This has been found to be one order 
of magnitude worse than the discarded weight of the von 
Neumann entropy, as expected. 

V. SUMMARY 

We have studied the density-matrix renormalization 
group method from the point of view of quantum data 
compression. The method has been applied to the half- 
filled 1-d Hubbard model in real space and to various 
molecules. Our findings are listed below: 

(1) We have shown an explicite relationship between 
the dimension of the Hilbert space of DMRG blocks and 



block entropy for any fixed accuracy or alternatively be- 
tween the superblock Hilbert space and block entropy. 

(2) We have presented a more rigorous truncation pro- 
cedure based on Kholevo's theory on accessible informa- 
tion. This method also provides a new extrapolation 
method. We have found numerically that on a logarith- 
mic scale the relative error is a linear function of the 
threshold value on the accessible information. 

(3) We have also studied models when lattice site en- 
tropies are not equivalent and demonstrated the effi- 
ciency of our new truncation procedure and criteria of 
convergence. 

(4) We have presented a sum rule which relates the 
sum of site entropies to the total information generated 
within a half sweep of the DMRG method. It has been 
shown that this could be used as an alternative test for 
convergence. 

The application of other concepts of quantum informa- 
tion theory ^] to DMRG might also prove to be useful 
when more complicated systems are studied. A more rig- 
orous study of entanglement distillation and purification 
protocols for systems when site entropies are not equiv- 
alent could lead to further optimization of the DMRG 
method. Another natural extension of the present work 
would be to use non-orthogonal states, however, the 
DMRG implementation of such a problem is rather com- 
plicated |37|. 
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